Information processing apparatus and non-transitory computer readable medium storing program

ABSTRACT

An information processing apparatus includes a processor, wherein an image indicating a configuration for a cooperation function and a connection image connecting the image indicating the configuration are provided, and after a plurality of images indicating the configurations are connected by the connection image, in a case where the image indicating the configuration is operated or an operation is applied to the connection image, the processor cancels a cooperation setting of the cooperation function and makes a change in correspondence with an operation adding a representation of the connection image.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation application of and claims thepriority benefit of a prior application Ser. No. 16/253,232, filed onJan. 22, 2019, now allowed. The prior application Ser. No. 16/253,232 isbased on and claims priority under 35 USC 119 from Japanese PatentApplication No. 2018-130290 filed Jul. 9, 2018.

BACKGROUND (i) Technical Field

The present invention relates to an information processing apparatus anda non-transitory computer readable medium storing a program.

(ii) Related Art

JP2015-177504A discloses an apparatus which acquires informationregarding cost required for a plurality of apparatuses to performcooperative operations, and presents the information regarding cost to auser in correlation with apparatuses performing the cooperativeoperations.

JP2015-223006A discloses a system which restricts an amount to be usedby a user when apparatuses are in cooperation.

WO2013/061517A discloses an apparatus which transmits an apparatus listincluding an unconnected apparatus which is an owned apparatus notretrieved this time and a connected apparatus which is an ownedapparatus retrieved this time, to an external server, displays apparatuscooperation services indicated by apparatus cooperation service listinformation and an apparatus determined as being an owned apparatus in alist form on a display unit, and allows a user to select an apparatuscooperation service.

SUMMARY

Meanwhile, a cooperation function may be set.

Aspects of non-limiting embodiments of the present disclosure relate toan information processing apparatus and a non-transitory computerreadable medium storing a program, capable of changing display of aconfiguration used for a cooperation function such that the cooperationfunction can be easily set.

Aspects of certain non-limiting embodiments of the present disclosureaddress the above advantages and/or other advantages not describedabove. However, aspects of the non-limiting embodiments are not requiredto address the advantages described above, and aspects of thenon-limiting embodiments of the present disclosure may not addressadvantages described above.

According to an aspect of the present disclosure, there is provided aninformation processing apparatus including a processor, wherein an imageindicating a configuration for a cooperation function and a connectionimage connecting the image indicating the configuration are provided,and after a plurality of images indicating the configurations areconnected by the connection image, in a case where the image indicatingthe configuration is operated or an operation is applied to theconnection image, the processor cancels a cooperation setting of thecooperation function and makes a change in correspondence with anoperation adding a representation of the connection image.

BRIEF DESCRIPTION OF THE DRAWINGS

Exemplary embodiment(s) of the present invention will be described indetail based on the following figures, wherein:

FIG. 1 is a block diagram illustrating a configuration of an informationprocessing system according to an exemplary embodiment of the presentinvention;

FIG. 2 is a block diagram illustrating a configuration of terminalequipment;

FIG. 3 is a diagram illustrating an independent function managementtable;

FIG. 4 is a diagram illustrating a screen;

FIG. 5 is a diagram illustrating a screen;

FIG. 6 is a diagram illustrating a screen;

FIG. 7 is a diagram illustrating a screen;

FIG. 8 is a diagram illustrating a screen;

FIG. 9 is a diagram illustrating a screen;

FIG. 10 is a diagram illustrating a screen;

FIG. 11 is a diagram illustrating a screen;

FIG. 12 is a diagram illustrating a screen;

FIG. 13 is a diagram illustrating a screen;

FIG. 14 is a diagram illustrating a state in which an arrow image iscut;

FIG. 15 is a diagram illustrating a screen;

FIG. 16 is a diagram illustrating a screen;

FIG. 17 is a diagram illustrating a screen;

FIGS. 18A, 18B and 18C are diagrams illustrating apparatus images; and

FIG. 19 is a diagram illustrating a set content management table.

DETAILED DESCRIPTION

With reference to FIG. 1, a description will be made of an informationprocessing system according to an exemplary embodiment. FIG. 1illustrates an example of an information processing system according tothe present exemplary embodiment.

The information processing system according to the present exemplaryembodiment includes one or a plurality of pieces of terminal equipmentand one or a plurality of apparatuses. In the example illustrated inFIG. 1, the information processing system includes terminal equipment 10and apparatuses 12A to 12T. This configuration is only an example, andthe information processing system may include a plurality of pieces ofterminal equipment 10, and may include other apparatuses. Hereinafter,in a case where the respective apparatuses are not required to bedifferentiated from each other, each apparatus will be referred to as an“apparatus 12”. The terminal equipment 10 may be included in theconceptual category of the apparatus 12. In other words, the terminalequipment 10 may be handled as the apparatus 12.

The terminal equipment 10 and each apparatus 12 have a function ofperforming communication with other apparatuses. The communication maybe wireless communication, and may be wired communication. For example,the terminal equipment 10 and each apparatus 12 may performcommunication with other apparatuses via communication paths such as theInternet or other networks, may perform direct communication with otherapparatuses, may perform communication with other apparatuses viarepeaters functioning as hubs, and may perform communication with otherapparatuses via a so-called cloud or a server. Each apparatus 12 may bea so-called Internet of Things (IoT) apparatus. A firewall forpreventing illegal intrusion into a communication path may be providedin the communication path. In the example illustrated in FIG. 1,firewalls 14A to 14D are provided.

The terminal equipment 10 as an information processing apparatus is anapparatus such as a personal computer (PC), a tablet PC, a smart phone,or a mobile phone, and has a function of performing communication withother apparatuses. The terminal equipment 10 may be a wearable terminal(for example, a wristwatch type terminal, a wristband type terminal, aspectacle type terminal, a ring type terminal, a contact lens typeterminal, an intracorporeal embedded type terminal, and a hearableterminal). The terminal equipment 10 may have a flexible display as adisplay device. As the flexible display, for example, an organicelectroluminescence type display (flexible organic EL display), anelectronic paper type display, or a flexible liquid crystal display isused. Flexible displays employing display methods other than thosedescribed may be used. The flexible display is a display of which adisplay portion is flexibly deformable, and is, for example, a displaywhich can be bent, folded, rolled, twisted, or stretched. The entireterminal equipment 10 may be configured with the flexible display, andthe flexible display and other configurations may be separate from eachother functionally or physically.

The apparatus 12 is an apparatus having a function, and is, for example,an image forming apparatus having image forming functions (for example,a scanning function, a printing function, a copying function, and afacsimile function), a PC, a tablet PC, a smart phone, a mobile phone, arobot (for example, a humanoid robot, an animal-type robot other than ahuman type, or a robot other than the above-described robots), aprojector, a display apparatus such as a liquid crystal display, arecording apparatus, a reproduction apparatus, an imaging apparatus suchas a camera, a refrigerator, a rice cooker, a microwave oven, a coffeemaker, a cleaner, a washing machine, an air conditioner, a lightingapparatus, a clock, a surveillance camera, an automobile, a motorcycle,an aircraft (for example, an unmanned aerial vehicle (a so-calleddrone)), a game machine, or various sensing apparatuses (for example, atemperature sensor, a humidity sensor, a voltage sensor, or a currentsensor). The apparatus 12 may be an apparatus (for example, an imageforming apparatus or a PC) which outputs information to a user, and maybe an apparatus (for example, a sensing apparatus) which does not outputinformation to a user. Among a plurality of apparatuses 12 performing acooperation function which will be described later, all apparatuses 12may be apparatuses outputting information to a user, some of theapparatuses 12 may be apparatuses outputting information to a user, andthe other apparatuses 12 may be information not outputting informationto a user, and all of the apparatuses 12 may be apparatuses notoutputting information to a user. The conceptual category of theapparatus 12 may include general apparatuses. For example, informationapparatuses, video apparatuses, audio apparatuses, and other apparatusesmay be included in the conceptual category of the apparatus 12.

In the present exemplary embodiment, a cooperation function is set byusing the terminal equipment 10 as an example. The cooperation functionis a function which is executable by using one or a plurality ofconfigurations. The configuration is, for example, the apparatus 12 ashardware, software, a function, or a target. The function is a functionof the apparatus 12 or the software. The target is, for example, a file(data) or a physical object. The terminal equipment 10 may also be usedas an apparatus which executes the cooperation function. The softwareused for the cooperation function may be installed in the terminalequipment 10, and may be installed in the apparatus 12. The apparatus 12may independently receive an instruction from a user and execute afunction, in a case of not in cooperation with other apparatuses 12. Ofcourse, the apparatus 12 (for example, a sensing apparatus) whichexecutes a function without receiving an instruction from a user may beincluded in the information processing system.

For example, setting information indicating a cooperation function usingthe apparatus 12 is stored in the apparatus 12, and the apparatus 12executes the cooperation function according to the setting information.The setting information may be stored in an apparatus such as arepeater, the terminal equipment 10, or a server controlling theapparatus 12, and the apparatus 12 may execute the cooperation functionunder the control of an apparatus such as the repeater, the terminalequipment 10, or the server. Setting information indicating acooperation function using software is stored in an apparatus such as arepeater, the terminal equipment 10, the apparatus 12, or a server inwhich the software is installed, and the software executes thecooperation function according to the setting information.

Here, the cooperation function will be described. The entire apparatus12, a specific portion of the apparatus 12, a specific function ofsoftware, or an aggregate function including a plurality of functionsmay be used for the cooperation function. For example, in a case where afunction is allocated to each portion of the apparatus 12, thecooperation function may be a function using the portions. Specifically,for example, it is assumed that a printing function is allocated to amain body portion of a multi-function peripheral having a plurality ofimage forming functions, a scanning function is allocated to a readingportion (for example, a portion corresponding to a document cover, adocument glass, or an automatic document feeder) of the multi-functionperipheral, and a postprocessing function (for example, a staplingfunction) is allocated to a postprocessing device of the multi-functionperipheral. In this case, the main body portion, the reading portion, orthe postprocessing device of the multi-function peripheral may be usedfor the cooperation function. As software, an aggregate function whichis determined in the block unit, such as Robotics Process Automation(RPA), may be used for the cooperation function. In a case wheresoftware has a plurality of functions, the cooperation function may be afunction using some of the plurality of functions. The aggregatefunction is configured with a plurality of functions, and the pluralityof functions are simultaneously or sequentially executed such that aprocess is performed according to the aggregate function. Thecooperation function may be a function using only hardware, may be afunction using only software, and may be a function using both ofhardware and software. Data such as an image file or a document file maybe used for the cooperation function.

The cooperation function may be a function which is executable throughcooperation of a plurality of apparatuses 12 of different types, and maybe a function which is executable through cooperation of a plurality ofapparatuses 12 of an identical type. The cooperation function may be afunction which cannot be used before cooperation. For example, theapparatus 12 (printer) having a printing function cooperates with theapparatus 12 (scanner) having a scanning function, and thus a copyingfunction as the cooperation function is executable. In other words, thecopying function is executable through cooperation of the printingfunction and the scanning function. This is also the same for software.In other words, the cooperation function may be a function which isexecutable through cooperation of a plurality of pieces of software ofdifferent types, and may be a function which is executable throughcooperation of a plurality of pieces of software of an identical type.

The conceptual category of the cooperation function may include acombined function in which a new function is executable by causing aplurality of the apparatuses 12 to cooperate with each other. Forexample, an extended display function as the combined function may berealized by combining a plurality of displays with each other. Asanother example, a recording function as the combined function may berealized by combining a television set with a recorder. The recordingfunction is, for example, a function of recording images displayed onthe television set. An imaging region extending function as the combinedfunction may be realized by combining a plurality of cameras with eachother. The extending function is, for example, a function in whichimaging is performed by connecting imaging regions of the respectivecameras to each other. A translation call function (a function in whicha conversation is translated via a telephone) as the combined functionmay be realized by combining a telephone with a translator ortranslation software. As mentioned above, the conceptual category of thecooperation function may include a function which is realizable bycausing a plurality of apparatuses 12 or a plurality of pieces ofsoftware of an identical type to cooperate with each other, and afunction which is realizable by causing a plurality of apparatuses 12 ora plurality of pieces of software of different types to cooperate witheach other.

A connected home (a system in which the apparatuses 12 such as homeappliances are connected to each other via a network by using an IoTtechnology) may be built by a plurality of apparatuses 12, and thecooperation function may be used in the connected home. In this case,the apparatuses 12 may be connected to each other via a specific server,and the apparatuses 12 may be connected to each other without using aspecific server.

A plurality of apparatuses 12 may be caused to cooperate with each othervia IFTTT so as to execute the cooperation function. In other words, acontent of the cooperation function may be that, in a case where anevent serving as a trigger occurs in any apparatus 12, another apparatus12 performs an action (process). For example, the cooperation functionmay be executed in which detection of opening of a door in a sensor asthe apparatus 12 serves as a trigger, and an action of lighting alighting apparatus as another apparatus 12 is performed. A function inwhich an action performed by any apparatus 12 serves as a trigger, andstill another apparatus 12 performs an action may also be included inthe conceptual category of the cooperation function. A function ofcausing a plurality of web services to cooperate with each other or APIcooperation in which a plurality of systems or services are caused tocooperate with each other by using the Application Programming Interface(API) may be included in the conceptual category of the cooperationfunction.

In the example illustrated in FIG. 1, the apparatus 12A is a server, theapparatus 12B is a surveillance camera, the apparatus 12C is a videocamera, the apparatus 12D is a multi-function peripheral having imageforming functions, the apparatus 12E is a notebook PC, the apparatus 12Fis a cache register, the apparatus 12G is an entry/exit gate, theapparatus 12H is a TV monitor, the apparatus 12K is a projector, theapparatus 12L is a communication base station, and the apparatus 12M isa repeater (for example, a router). The apparatuses 12A and 12M and theterminal equipment 10 are connected to the apparatus 12L. Theapparatuses 12A to 12K are connected to the apparatus 12M. The firewall14A is provided on a communication path between the apparatus 12A andthe apparatus 12L. The firewall 14B is provided on a communication pathbetween the apparatus 12L and the apparatus 12M. The firewall 14C isprovided on a communication path between the apparatus 12A and theapparatus 12M.

The apparatus 12N is an air cleaner, the apparatus 12P is an audioapparatus, the apparatus 12Q is a recorder, the apparatus 12R is an airconditioner, the apparatus 12S is a sensor, and the apparatus 12T is arepeater (for example, a router). The apparatuses 12N to 12S areconnected to the apparatus 12T. The apparatus 12T is connected to theapparatus 12M. The firewall 14 d is provided on a communication pathbetween the apparatus 12T and the apparatus 12M.

For example, pieces of data 16A and 16B (for example, instructioninformation and a file) are transmitted and received between theterminal equipment 10 and the apparatus 12, or between the apparatuses12.

The repeater may control another apparatus 12 (for example, hardware ofanother apparatus 12 and software installed in another apparatus 12)connected to the repeater. The repeater may acquire various pieces ofinformation by using the Internet or the like. The repeater may functionas a server, and may manage data and user information. The repeater maybe a so-called smart speaker (an apparatus having a wirelesscommunication function and a speaker function), and may be an apparatuswhich has a communication function but does not have a speaker function.The repeater may be provided indoors (for example, on a floor of a room,a ceiling, or a table), and may be provided outdoors. The repeater maybe a movable apparatus (for example, an automatic apparatus).

Each apparatus 12 is configured to automatically execute an independentfunction in response to a user's instruction or regardless of a user'sinstruction. Each apparatus 12 may execute a cooperation function settherein. For example, setting information indicating a content of acooperation function is stored in each apparatus 12 used for thecooperation function, and each apparatus 12 executes the cooperationfunction indicated by the setting information stored therein incooperation with other apparatuses 12.

As mentioned above, one or a plurality of pieces of terminal equipment10 or one or a plurality of apparatuses 12 are present in a real space.One or a plurality of pieces of software are installed in the terminalequipment 10 and each apparatus 12. Of course, the terminal equipment 10and the apparatus 12 in which software is not installed may be includedin the information processing system according to the present exemplaryembodiment. The software is present in a virtual space (for example, avirtual space formed by a storage region in which the software isstored).

Hereinafter, with reference to FIG. 2, a configuration of the terminalequipment 10 will be described in detail. FIG. 2 illustrates an exampleof a configuration of the terminal equipment 10.

A communication section 18 is a communication interface, and has afunction of transmitting data to other apparatuses, and a function ofreceiving data from other apparatuses. The communication section 18 maybe a communication interface having a wireless communication function,and may be a communication interface having a wired communicationfunction. The communication section 18 may conform to, for example, asingle or plural types of communication methods, and may performcommunication with a communication partner according to a communicationmethod suitable for the communication partner (that is, a communicationmethod to which the communication partner conforms). The communicationmethod is, for example, infrared communication, visible lightcommunication, Wi-Fi (registered trademark) communication, orshort-range radio communication (for example, Near Field Communication(NFC)). As the short-range radio communication, for example, Felica(registered trademark), Bluetooth (registered trademark), or the RadioFrequency Identifier (RFID) is used. The communication section 18 maycope with the 5th Generation (5G). Of course, other types of wirelesscommunication may be used as the short-range radio communication. Thecommunication section 18 may change a communication method or afrequency bandwidth according to a communication partner, and may changea communication or a frequency bandwidth according to a surroundingenvironment. As the frequency bandwidth, for example, 2.4 GHz or 5 GHzmay be used.

A UI section 20 is a user interface section, and includes a display unitand an operation unit. The display unit is a display device such as aliquid crystal display. The display unit may be a flexible display. Theoperation unit is an input device such as a touch panel or a keyboard.The UI section 20 may be a user interface (including, for example, atouch display or a device in which a keyboard or the like iselectronically displayed on a display) which functions as both of adisplay unit and an operation unit. The UI section 20 may include asound collecting unit such as a microphone or a sound generation unitsuch as a speaker. In this case, information may be input to theterminal equipment 10 through voice input, and information may be outputwith a voice.

A storage section 22 is a storage device such as a hard disk drive or amemory (for example, an SSD). The storage section 22 stores, forexample, various pieces of data, and various programs (software). As theprograms, an operating system (OS) and various application programs(software) are stored. The storage section 22 stores apparatus addressinformation (for example, an IP address or a MAC address allocated tothe apparatus 12) indicating addresses of each apparatus 12. The storagesection 22 stores independent function management information and setcontent management information.

The independent function management information is information formanaging functions of each apparatus 12 and each piece of software asconfigurations, and output contents of data or the like output from eachapparatus 12 and each piece of software. For example, the independentfunction management information is created in advance and is stored inthe storage section 22.

The set content management information is information for managing a setcooperation function. For example, in function management information, acombination of configuration identification information for identifyingeach configuration used for a cooperation function is associated withfunction information regarding the cooperation function for eachcooperation function.

As the configuration identification information, for example, the nameor a symbol of a configuration, or an image associated with theconfiguration is used. The function information includes, for example,identification information such as the name or an ID of a cooperationfunction, and content information indicating a content of thecooperation function. Hereinafter, an image associated with aconfiguration will be referred to as a “configuration image”.

In a case where a configuration is the apparatus 12, the configurationidentification information is information (apparatus identificationinformation) for identifying the apparatus 12. In a case where aconfiguration is software, the configuration identification information(software identification information) is for identifying the software.In a case where a configuration is a target, the configurationidentification information (target identification information) is foridentifying the target. The configuration identification information foridentifying the apparatus 12 may include information indicating afunction of the apparatus 12. Similarly, the configurationidentification information for identifying the software may includeinformation indicating a function of the software.

The apparatus identification information is, for example, informationindicating the name of the apparatus 12, an apparatus ID, or the type ofapparatus 12, a model number of the apparatus 12, information (forexample, asset management information) for managing the apparatus 12,information (apparatus position information) indicating a position wherethe apparatus 12 is provided, an image (apparatus image) associated withthe apparatus 12, or apparatus address information. The apparatus imageis, for example, an appearance image representing the apparatus 12. Theappearance image may be an image representing an outside (for example, acasing of the apparatus) of the apparatus 12, may be an imagerepresenting a state (for example, an internal structure) in which acasing is opened, and the inside thereof is viewed from the outside, oran image representing a state in which the apparatus 12 is covered witha packaging sheet. The apparatus image is an image (an imagerepresenting an appearance of the apparatus 12 or an image representingthe inside thereof) generated by imaging the apparatus 12 with animaging apparatus such as a camera, and may be an image (for example, anicon) schematically representing the apparatus 12. The apparatus imagemay be a still image, and may be a moving image. Data of the apparatusimage may be stored in the storage section 22, and may be stored inother apparatuses (for example, the apparatus 12 or a server).

The software identification information is, for example, informationindicating the name of the software, a software ID, or the type ofsoftware, a model number of the software, information for managing thesoftware, an image (software image) associated with the software. Thesoftware image is, for example, an image (for example, an icon)representing a function of the software. The software image may be astill image, and may be a moving image. Data of the software image maybe stored in the storage section 22, and may be stored in otherapparatuses (for example, the apparatus 12 or a server).

The target identification information is, for example, informationindicating the name of the target, a target ID, or the type of target,or an image (target image) associated with the target. For example, in acase where the target is a file (data), the name or the like of the file(for example, an image file or a document file) is used as the targetidentification information. In a case where the target is a physicalobject (for example, a commodity), the name or the like of the object isused as the target identification information. The target image is animage (a still image or a moving image) generated by imaging a physicaltarget with an imaging apparatus such as a camera, and may be an image(for example, an icon) schematically representing the target. Data ofthe target image may be stored in the storage section 22, and may bestored in other apparatuses (for example, the apparatus 12 or a server).

The independent function management information and the set contentmanagement information may be stored in the apparatus 12 or a server. Inthis case, such information may not be stored in the terminal equipment10. Hereinafter, it is assumed that the information is stored in theterminal equipment 10.

A control section 24 is configured to control an operation of eachsection of the terminal equipment 10. For example, the control section24 executes various programs (software), controls communication usingthe communication section 18, controls an information notification (forexample, information display and voice output) using the UI section 20,receives information which is input to the terminal equipment 10 byusing the UI section 20, writes information into the storage section 22,and reads information from the storage section 22. The control section24 includes a display control unit 26 and a setting unit 28.

The display control unit 26 is configured to display various pieces ofinformation on the display unit of the UI section 20. For example, thedisplay control unit 26 displays a configuration image associated with aconfiguration (for example, the apparatus 12, a function, software, or atarget) used for a cooperation function, on the display unit. Thedisplay control unit 26 displays a configuration image in different waysin cases where the configuration image associated with the configurationused for the cooperation function is displayed in a region for settingthe cooperation function and is not displayed in the region.

The setting unit 28 is configured to set a cooperation function in aconfiguration (for example, the apparatus 12, a function, software, or atarget). The setting unit 28 registers information indicating a setcontent of the cooperation function in the set content managementinformation.

The setting unit 28 may be provided in the apparatus 12, and processesin the setting unit 28 may be performed by the apparatus 12. In thiscase, the setting unit 28 may not be provided in the terminal equipment10. Hereinafter, it is assumed that the setting unit 28 is provided inthe terminal equipment 10.

Hereinafter, with reference to FIG. 3, the independent functionmanagement information will be described in detail. FIG. 3 illustratesan example of an independent function management table as theindependent function management information.

In the independent function management table illustrated in FIG. 3, asan example, configuration identification information for identifying theapparatus 12 or software, independent function information indicating anindependent function of the apparatus 12 or the software, andinformation indicating a content (for example, data or an object) outputfrom the apparatus 12 or the software are correlated with each other.The independent function management table is created in advance and isstored in the storage section 22.

The apparatus 12 registered in the independent function management tableis the apparatus 12 included in the information processing system. In acase where the new apparatus 12 is added to the information processingsystem, an independent function and an output content of the apparatus12 may be registered in the independent function management table. Thesoftware registered in the independent function management table issoftware installed in the terminal equipment 10 or the apparatus 12. Ina case where new software is installed in the terminal equipment 10 orthe apparatus 12, an independent function and an output content of thesoftware may be registered in the independent function management table.For example, information is transmitted and received between theterminal equipment 10 and each apparatus 12, and thus the independentfunction management table is updated. Information registered in theindependent function management table may be shared by the terminalequipment 10 and each apparatus 12.

Hereinafter, contents registered in the independent function managementtable will be described in detail.

A sensor A as the apparatus 12 has sensing functions such as atemperature sensing function, a humidity sensing function, and apressure sensing function, and outputs a sensing result (for example,data such as temperature data, humidity data, or pressure data) as anoutput content.

A multi-function peripheral B as the apparatus 12 has image formingfunctions such as a scanning function, a printing function, and acopying function, and outputs image data or printed matter as an outputcontent.

A robot C as the apparatus 12 has, for example, a conveyance function,an imaging function, a conversation function, and a retrieval function,and outputs, for example, image data or voice data as an output content.

An application 1 as software has, for example, a statistical function,and outputs, for example, statistical data as an output content.

An application 2 as software has, for example, a document creationfunction, and outputs, for example, document data as an output content.

An application 3 as software has, for example, an image processingfunction, and outputs, for example, image data as an output content.

The apparatuses 12 and the software are only examples, and otherapparatuses 12 and software may be registered in the independentfunction management table. An independent function allocated to eachportion of the apparatus 12 may be registered in the independentfunction management table. For example, in a case where a printingfunction is allocated to a main body portion B1 of the multi-functionperipheral B, information indicating the main body portion B1 andinformation indicating the printing function are registered in theindependent function management table in correlation with each other.Software associated with a file (data) as a target may be registered inthe independent function management table.

By referring to the independent function management table, anindependent function and an output content of each of the apparatus 12and the software are specified.

Hereinafter, with reference to FIG. 4, a description will be made of ascreen displayed on the display unit of the UI section 20. FIG. 4illustrates an example of the screen. The display control unit 26displays a screen 30 on the display unit, and displays various pieces ofinformation on the screen 30. The screen 30 is, for example, a homescreen or a desktop screen. The screen 30 includes a main display region32 and a task bar 34. Images such as icons, and various windows aredisplayed in the main display region 32. For example, an apparatus image36 associated with the multi-function peripheral B, an apparatus image38 associated with a PC (D), an apparatus image 40 associated with thesensor A, an image 42 associated with document software, and an image 44associated with image management software are displayed in the maindisplay region 32. Images such as icons are displayed in the task bar34. For example, an image 46 associated with electronic mail software,an image 48 associated with presentation software, and an image 50associated with document creation software are displayed in the task bar34. A button image 54 for displaying a menu 52 is displayed in the taskbar 34. In a case where a user presses the button image 54 (for example,the user clicks the button image 54), the menu 52 is displayed in themain display region 32. A list of software is displayed in the menu 52.For example, images 56 and 58 associated with the software are displayedin the menu 52. In a case where an arrow button image displayed in thetask bar 34 is pressed by the user, an image associated with anotherpiece of software may be displayed in the task bar 34.

For example, the display control unit 26 may display an image associatedwith the apparatus 12 identified by the terminal equipment 10 or otherpieces of equipment on the screen 30, may display an image associatedwith software installed in the terminal equipment 10 on the screen 30,and may display an image associated with software installed in theapparatus 12 on the screen 30. For example, the apparatus 12 is imagedby an imaging apparatus such as a camera, and the apparatus 12 isidentified on the basis of image data which is generated through theimaging. The identification process may be performed by the terminalequipment 10, and may be performed by other pieces of equipment (forexample, a server). The display control unit 26 may display an imageassociated with the apparatus 12 identified in the above-described wayon the screen 30. The display control unit 26 may display an imageassociated with the apparatus 12 connected to the terminal equipment 10on the screen 30, and may display an image associated with softwareinstalled in the apparatus 12 on the screen 30. For example, theterminal equipment 10 retrieves the apparatus 12 connected thereto, andthe display control unit 26 displays an image associated with theretrieved apparatus 12 on the screen 30. The display control unit 26 maydisplay an image associated with software installed in the retrievedapparatus 12 on the screen 30. The display control unit 26 may displayan image associated with data stored in the terminal equipment 10 on thescreen 30, and may display an image associated with data stored in theapparatus 12 on the screen 30.

The screen 30 illustrated in FIG. 4 is only an example of a screendisplayed on the display unit, and other screens may be displayed on thedisplay unit. For example, in a case where an operation of setting acooperation function is performed, other screens may be displayed.

Hereinafter, with reference to FIG. 5, a description will be made of asummary of an operation of setting a cooperation function. FIG. 5illustrates an example of a screen displayed on the display unit of theUI section 20. The display control unit 26 displays, for example, ascreen 60 on the display unit. As examples of configuration images, theapparatus image 36 associated with the multi-function peripheral B, theapparatus image 40 associated with the sensor A, a function image 62associated with a correlation function, the apparatus image 38associated with the PC (D), and a function image 64 associated with apreservation function are displayed on the screen 60. Each of thecorrelation function and the preservation function may be realized bythe apparatus 12 as hardware, and may be realized by software.

In a case where the user connects configuration images to each other onthe screen 60, the setting unit 28 identifies a configuration associatedwith each of the plurality of configuration images connected by the useras a configuration used for a cooperation function, and registers theconfiguration in the set content management information as aconfiguration used for the cooperation function. An output destinationof data output from each configuration is designated by the user, andthe setting unit 28 registers information indicating an outputdestination of data for each configuration in the set content managementinformation.

In a case where the user designates a configuration image associatedwith a configuration on the screen 60, the display control unit 26specifies one or a plurality of functions of the configurationassociated with the configuration image in the independent functionmanagement table, and displays information (a list of functions)indicating the one or plurality of functions on the screen 60. The userdesignates a function (a function used for a cooperation function) to beexecuted by the configuration from the list of functions. The userdesignates a condition for executing the function. For example,condition candidates are associated with each configuration, andinformation indicating the association is registered in the independentfunction management table in advance. The display control unit 26displays a list of condition candidates associated with theconfiguration designated by the user on the screen 60. The userdesignates a condition from the list of the candidates. The setting unit28 sets the function in the configuration as a function used for acooperation function, sets the condition in the configuration, andregisters such a set content in the set content management information.

During execution of a cooperation function, each configuration executesa function associated therewith in a case where a condition associatedwith the configuration occurs, and outputs data to a data outputdestination associated with the configuration.

The respective configurations are connected to each other by the user soas to be designated as configurations which all will execute acooperation function, and the setting unit 28 registers the respectiveconfigurations in the set content management information asconfigurations used for the cooperation function.

Hereinafter, a specific example will be described. For example, in acase where the user performs an operation of connecting the apparatusimage 40 to the function image 62 by operating the UI section 20, thedisplay control unit 26 displays an arrow image 66 connecting theapparatus image 40 to the function image 62 on the screen 60. The arrowimage 66 corresponds to an example of an image associated with aconnection member. The image associated with a connection member is notlimited to an image having an arrow shape. Images having other shapesmay be used as an image associated with a connection member asappropriate. For example, images associated with a plurality of types ofconnection members may be stocked, and the user may select and use animage from among the plurality of types of images. As examples of imagesother than an arrow image, a circular image, a rectangular image, and acurved image may be used. In this case, the setting unit 28 connects thesensor A associated with the apparatus image 40 to the correlationfunction associated with the function image 62, and registers the sensorA and the correlation function in the set content management informationas configurations used for the cooperation function. A destinationindicated by the arrow image 66 indicates a data output destination. Inthe example illustrated in FIG. 5, the arrow image 66 indicates thefunction image 62, and thus data is output to the correlation functionfrom the sensor A during execution of the cooperation function. In acase where the user designates the apparatus image 40, the displaycontrol unit 26 displays a single function or a list of a plurality offunctions of the sensor A on the screen 60 by referring to theindependent function management table. In a case where the user selectsa function to be executed by the sensor A from the list, the settingunit 28 sets the function designated by the user in the sensor A as afunction used for the cooperation function, and registers a set contentin the set content management information. This is also the same for thecorrelation function.

The above description is also similarly applied to other configurationimages. For example, the apparatus image 36 associated with themulti-function peripheral B and the function image 62 associated withthe correlation function are connected to each other via an arrow image68. The function image 62 and the apparatus image 38 associated with thePC (D) are connected to each other via an arrow image 70. The apparatusimage 38 and the function image 64 associated with the preservationfunction are connected to each other via an arrow image 72. A functionused for the cooperation function and a condition for executing thefunction are designated by the user for each of the multi-functionperipheral B, the PC (D), and the preservation function. The settingunit 28 sets the function and the condition designated by the user ineach of the multi-function peripheral B, the PC (D), and thepreservation function, and registers the set contents in the set contentmanagement information. The setting unit 28 registers informationindicating a data output destination indicated by each arrow image inthe set content management information.

The display control unit 26 displays a connection portion imageindicating a portion connected to the arrow image to overlap eachconfiguration image on the screen 60. The arrow image is connected tothe connection portion image in the configuration image.

For example, a connection portion image 40 a is displayed to overlap theapparatus image 40. The arrow image 66 is connected to the connectionportion image 40 a in the apparatus image 40. This is also the same forother configuration images. A connection portion image 36 a is displayedto overlap the apparatus image 36. Connection portion images 62 a, 62 b1, and 62 b 2 are displayed to overlap the function image 62. Connectionportion images 38 a and 38 b are displayed to overlap the apparatusimage 38. A connection portion image 64 b is displayed to overlap thefunction image 64. Each arrow image is connected to each connectionportion image. A connection portion image may be displayed at a positionseparated from a configuration image instead of overlapping theconfiguration image. A display position of a connection portion imagemay be changed by the user operating the connection portion image.

The connection portion image is an image smaller than a configurationimage, and is, for example, a circular image, a rectangular image, or anx-mark image. Of course, the connection portion image may be otherimages. A part of the configuration image may be used as a connectionportion image. A transparent small image may be set in a part of aconfiguration image as a connection portion image.

Each of the connection portion images indicates output or input of data.For example, in a configuration image, a display region of a connectionportion image indicating output of data and a display region of aconnection portion image indicating input of data are set. In theexample illustrated in FIG. 5, a right region of each configurationimage is a display region indicating output of data, and a left regionthereof is a display region indicating input of data.

The connection portion image displayed in the display region indicatingoutput of data is an image indicating output of data. The connectionportion image displayed in the display region indicating input of datais an image indicating input of data.

In a case where an arrow image is connected to a connection portionimage indicating output of data, a configuration associated with aconfiguration image having the connection portion image outputs data toa configuration indicated by the arrow image. In a case where an arrowimage is connected to a connection portion image indicating input ofdata, data output from another configuration is input to a configurationassociated with a configuration image having the connection portionimage.

The display control unit 26 may make a display aspect of a connectionportion image indicating output of data different from a display aspectof a connection portion image indicating input of data. The displayaspect is, for example, a color, a shape, a size, transparency, thepresence or absence of linking, or an aspect of linking. For example, aconnection portion image indicating output of data is displayed violet,and a connection portion image indicating input of data is displayedred.

In the example illustrated in FIG. 5, the connection portion images 36a, 38 a, 40 a, and 62 a are displayed in the display regions indicatingoutput of data, and correspond to connection portion images indicatingoutput of data. The connection portion images 62 b 1, 62 b 2, and 64 bare displayed in the display regions indicating input of data, andcorrespond to connection portion images indicating input of data. Aplurality of connection portion images (the connection portion images 62b 1 and 62 b 2) indicating input of data are displayed to overlap thefunction image 62. As mentioned above, in a single configuration image,a plurality of connection portion images indicating input of data may bedisplayed, and a plurality of connection portion images indicatingoutput of data may be displayed.

In the example illustrated in FIG. 5, the sensor A, the multi-functionperipheral B, the correlation function, the PC (D), and the preservationfunction are set as configurations used for a cooperation function, andthe cooperation function executed by using the configurations isregistered in the set content management information.

In a case where execution of a registered cooperation function is set tobe active (ON), and a condition occurs, the cooperation function isexecuted. In a case where execution of a cooperation function is set toOFF, the cooperation function is not executed even if a conditionoccurs. ON or OFF of execution is set by, for example, the user. Ofcourse, ON and OFF may not be set, and a cooperation function may beexecuted in a case where a condition occurs.

In a case where execution of a cooperation function is set to be active(ON), and a condition associated with the sensor A occurs, the sensor Aoutputs data sensed by the sensor A to the correlation function.Similarly, the multi-function peripheral B outputs data generated oracquired by the multi-function peripheral B to the correlation function.Both of the pieces of data are input to the correlation function, andthus a condition associated with the correlation function is satisfied,and thus the correlation function is executed. Consequently, the datafrom the sensor A is correlated with data from the multi-functionperipheral B. The correlation function may be executed by the terminalequipment 10, and may be executed by the apparatus 12. The data fromeach of the sensor A and the multi-function peripheral B is output tothe terminal equipment 10 or the apparatus 12 executing the correlationfunction. The data from the sensor A and the data from themulti-function peripheral B are output from the correlation function(the terminal equipment 10 or the apparatus 12) to the PC (D) in a stateof correlation. The data is input to the PC (D) from the correlationfunction, and thus a condition associated with the PC (D) is satisfied.Therefore, the PC (D) executes a function set in the PC (D), and outputsdata as a result of executing the function to the preservation function(the terminal equipment 10 or the apparatus 12 executing thepreservation function). The data is input to the preservation functionfrom the PC (D), and thus a condition associated with the preservationfunction is satisfied. Therefore, the terminal equipment 10 or theapparatus 12 executes the preservation function, and thus the dataoutput from the PC (D) is preserved in a preservation destination. Thesetting unit 28 registers information indicating the set content of thecooperation function in the set content management information.

The type of data to be output to another configuration may be changedaccording to the type of arrow image. For example, it is assumed thatthe sensor A can output temperature data, humidity data, and pressuredata, and the types of arrow images (for example, a color, a shape, or athickness) are respectively associated with the types of data. Forexample, temperature data is associated with a red arrow image, andhumidity data is associated with a blue arrow image. In a case where theuser selects a red arrow image as the arrow image 66 connecting theapparatus image 40 associated with the sensor A with the function image62, the setting unit 28 sets temperature data in the sensor A as thetype of data output from the sensor A to the correlation function, andregisters the set content in the set content management information. Inthis case, during execution of a cooperation function, the sensor Aoutputs temperature data to the correlation function (the terminalequipment 10 or the apparatus 12). For example, in a case where the userdesignates the arrow image 66 on the screen 60, the display control unit26 displays a list of arrow image candidates corresponding to data whichcan be output from the sensor A on the screen 60. In a case where theuser selects an arrow image from the list, the setting unit 28identifies the type of data output from the sensor A, and sets the typeof data in the sensor A. This is also the same for arrow imagesconnected to other configuration images.

A length, a thickness, or a shape of an arrow image may indicate anexecution timing or the like of performance or a function of datacommunication. In other words, an execution timing or the like ofperformance or a function of data communication may be changed by theuser changing a length, a thickness, or a shape of an arrow image.

Hereinafter, with reference to FIG. 6, a display aspect of a connectionportion image will be described in detail. FIG. 6 illustrates an exampleof a screen displayed on the display unit of the UI section 20. Forexample, in a case where a program for setting a cooperation function isexecuted in response to an instruction from the user, the displaycontrol unit 26 displays a screen 74 on the display unit of the UIsection 20. The screen 74 includes, for example, a display region 76 forsetting a cooperation function, a display region 78 in which stockedconfiguration images are displayed, a display region 80 in which stockedfunction images are displayed, and a display region 82 in which stockedarrow images are displayed.

A configuration image associated with a configuration used for acooperation function is displayed in the display region 76. Byconnecting configuration images displayed in the display region 76 toeach other, the user may designate configurations used for a cooperationfunction, and may set a function to be executed by each configuration.

One or a plurality of stocked configuration images are displayed in thedisplay region 78. In the display region 78, for example, eachconfiguration image is displayed as a thumbnail image. For example, anapparatus image associated with an apparatus identified by the terminalequipment 10, a software image associated with software installed in theterminal equipment 10, a software image associated with softwareinstalled in the apparatus 12 are displayed in the display region 78.Direction key images 78 a and 78 b are displayed in the display region78. In a case where the user presses the direction key image 78 a (abutton image indicating the rightward direction) on the screen 74, eachconfiguration image displayed in the display region 78 is moved in thedirection (rightward direction) indicated by the direction key image 78a, and other configuration images are displayed in the display region78. This is also the same for a case where the direction key image 78 b(a button image indicating the leftward direction) is pressed. A buttonimage indicating the upward direction and a button image indicating thedownward direction may be displayed, and display of a configurationimage is changed in the upward direction or the downward direction. Alist button image 78 c is displayed in the display region 78. In a casewhere the user presses the list button image 78 c on the screen 74, alist of configuration images is displayed on the screen 74. A connectionportion image is not displayed on each configuration image in thedisplay region 78.

One or a plurality of stocked function images are displayed in thedisplay region 80. In the display region 80, for example, each functionimage is displayed as a thumbnail image. For example, a function imageassociated with a function of the terminal equipment 10 and a functionimage associated with a function of the apparatus 12 are displayed inthe display region 80. A direction key image 80 a is displayed in thedisplay region 80. In a case where the user presses the direction keyimage 80 a on the screen 74, each function image displayed in thedisplay region 80 is moved in the direction (for example, the rightwarddirection) indicated by the direction key image 80 a, and other functionimages are displayed in the display region 80. A connection portionimage is not displayed on each function image in the display region 80.

One or a plurality of arrow images are displayed in the display region82. An arrow image is an image used to connect configuration images toeach other. In a case where one or a plurality of arrow imagesindicating the type of data to be output, an execution timing ofperformance or a function of data communication, and the like areprepared, the one or plurality of arrow images are displayed in thedisplay region 82. In a case where the user presses a direction keyimage 82 a on the screen 74, each arrow image displayed in the displayregion 82 is moved in the direction (for example, the rightwarddirection) indicated by the direction key image 82 a, and other arrowimages are displayed in the display region 82.

In a case where the user operates the UI section 20 so as to perform anoperation of moving a configuration image displayed in the displayregion 78 from the display region 78 to the display region 76, thedisplay control unit 26 displays the configuration image in the displayregion 76 by moving the configuration image from the display region 78to the display region 76. For example, the display control unit 26displays a configuration image displayed to be reduced in the displayregion 78, to be enlarged in the display region 76. In the exampleillustrated in FIG. 6, as indicated by an arrow 84, the apparatus image36 displayed in the display region 78 is designated by the user, and ismoved to the display region 76. The display control unit 26 enlarges anddisplays the apparatus image 36 in the display region 76 in response tothe operation.

The function images displayed in the display region 80 and the arrowimages displayed in the display region 82 are also displayed in thedisplay region 76 in response to the user's operation in the same manneras the apparatus image 36.

In the example illustrated in FIG. 6, in response to the user'soperation, the apparatus image 36 associated with the multi-functionperipheral B, the function image 64 associated with the preservationfunction, and the apparatus image 38 associated with the PC (D) aredisplayed in the display region 76. In the display region 76, acooperation function is set for such configuration images.

In a case where a configuration image is displayed in the display region76 for setting a cooperation function, the display control unit 26displays a connection portion image to overlap the configuration imageon the screen 74. This is also the same for a case where a functionimage is displayed in the display region 76.

For example, in a case where the apparatus image 36 associated with themulti-function peripheral B is moved from the display region 78 to thedisplay region 76 and is displayed in the display region 76 in responseto the user's operation, the display control unit 26 displays theconnection portion image 36 a to overlap the apparatus image 36 in thedisplay region 76. In other words, the connection portion image 36 a isnot displayed to overlap the apparatus image 36 in the display region78, but the connection portion image 36 a is displayed to overlap theapparatus image 36 in the display region 76. In the example illustratedin FIG. 6, the single connection portion image 36 a indicating output ofdata from the multi-function peripheral B is displayed to overlap theapparatus image 36, but a plurality of connection portion imagesindicating output of data may be displayed to overlap the apparatusimage 36, and a connection portion image indicating input of data to themulti-function peripheral B may be displayed to overlap the apparatusimage 36. In a case where the user operates the apparatus image 36 onthe screen 74 (for example, the user clicks the apparatus image 36), thedisplay control unit 26 may display at least one of a connection portionimage for data output or a connection portion image for data input tooverlap the apparatus image 36 in the display region 76. The displaycontrol unit 26 may display a connection portion image for data outputor a connection portion image for data input to overlap the apparatusimage in response to the user's instruction. For example, in a casewhere the user designates a right region (a region corresponding to dataoutput) of a configuration image (for example, the user clicks theconfiguration image), the display control unit 26 displays a connectionportion image for data output to overlap the configuration image. On theother hand, in a case where the user designates a left region (a regioncorresponding to data input) of a configuration image, the displaycontrol unit 26 displays a connection portion image for data input tooverlap the configuration image. This is also the same for the apparatusimage 38 associated with the PC (D).

A region corresponding to data output and a region corresponding to datainput may be changed by the user. For example, a left region of aconfiguration image may be set as a region corresponding to data output,and a right region of the configuration image may be set as a regioncorresponding to data input. An upper region and a lower region may berespectively set as a region for data output and a region for datainput. Of course, any region may be set as a region for data output or aregion for data input by the user.

In a case where the function image 64 associated with the preservationfunction is moved from the display region 80 to the display region 76and is displayed in the display region 76 in response to the user'soperation, the display control unit 26 displays connection portionimages 64 a and 64 b to overlap the function image 64 in the displayregion 76. In other words, the connection portion images 64 a and 64 bare not displayed to overlap the function image 64 in the display region80, but the connection portion images 64 a and 64 b are displayed tooverlap the function image 64 in the display region 76. The connectionportion image 64 a indicating output of data from the preservationfunction (the terminal equipment 10 or the apparatus 12) and theconnection portion image 64 b indicating input of data to thepreservation function are displayed to overlap the function image 64,but either of the connection portion image 64 a or 64 b may bedisplayed, and other connection portion images may be displayed. In thesame manner as in the apparatus image 36, a connection portion image maybe displayed to overlap the function image 64 in a case where the useroperates the function image 64.

A connection portion image is displayed to overlap a configuration imagein the display region 76 for setting a cooperation function, and theconnection portion image is not displayed to overlap the configurationimage in the display regions 78 and 80, and thus a display space of theconnection portion image is not allocated in the display regions 78 and80.

In a case where a connection portion image is displayed to overlap aconfiguration image, a portion overlapping the connection portion imageis not displayed in the configuration image, and the configuration imageis displayed in a state in which a part of the configuration image isomitted, but display control is performed as described above, and thusthe configuration image is not omitted in the display regions 78 and 80.For example, as a size of the display region 76 is increased in order toimprove the operability of the user for cooperation, areas of thedisplay regions 78 and 80 are required to be reduced, and thusconfiguration images displayed in the display regions 78 and 80 are alsodisplayed to be small according to the areas of the display regions 78and 80. In this case, in a case where a connection portion image isdisplayed in each of the display regions 78 and 80, the configurationimage displayed to be small is displayed to be omitted by the connectionportion image, and thus a situation occurs in which it is hard for theuser to view the configuration image. According to the display control,the occurrence of such a situation is prevented.

Since all of a configuration image which a connection portion image fordata output is displayed to overlap, a configuration image which aconnection portion image for data input is displayed to overlap, and aconfiguration image which connection portion images for data output andinput are displayed to overlap are not required to be created in advanceand to be displayed in the display regions 78 and 80, the number ofimages stocked and displayed in the display regions 78 and 80 isreduced.

In the example illustrated in FIG. 6, the apparatus image 36 and thefunction image 64 are connected to each other via an arrow image 86, andthe function image 64 and the apparatus image 38 are connected to eachother via an arrow image 88. A function set in each configuration (themulti-function peripheral B, the preservation function, and the PC (D))and a condition for executing the function are set by the user. Forexample, the multi-function peripheral B performs scanning, image datagenerated due to the scanning is output to the preservation function(the terminal equipment 10 or the apparatus 12), and the image data isoutput to the PC (D) so as to be preserved in the PC (D) as a result ofexecuting the preservation function. The image data may be directlyoutput to the PC (D) from the multi-function peripheral B. The settingunit 28 registers the cooperation function set in the above-describedway, in the set content management information.

An arrow image is extractable from the display region 82, but, in a casewhere the user performs an operation (for example, a pulling operation)on a connection portion image, the display control unit 26 may displayan arrow image extending from the connection portion image on thedisplay unit.

In a case where functions are respectively allocated to portions of aconfiguration, connection portion images may be respectively displayedfor portion images associated with the portions. For example, it isassumed that a printing function is allocated to a main body portion ofthe multi-function peripheral B, and a stapling function is allocated toa postprocessing portion thereof. In this case, the display control unit26 displays a connection portion image to overlap a portion imageassociated with the main body portion in the apparatus image 36 on thedisplay unit, and displays another connection portion image to overlap aportion image associated with the postprocessing portion in theapparatus image 36 on the display unit. In the above-described way,output of data from each portion and input of data to each portion canbe separately set.

Modification Example 1

Hereinafter, with reference to FIG. 7, a description will be made ofModification Example 1. FIG. 7 illustrates an example of a screen. InModification Example 1, in a case where a configuration image isdisplayed in the display region 76, a connection portion image isdisplayed to overlap the configuration image on the display unitaccording to a positional relationship between the configuration imageand an arrow image. For example, the display control unit 26 displaysthe connection portion image to overlap the configuration image on thedisplay unit in a case where a distance between the configuration imageand the arrow image is equal to or less than a threshold value in thedisplay region 76, and does not display the connection portion image tooverlap the configuration image on the display unit in a case where thedistance exceeds the threshold value. The threshold value may be set inadvance, and may be changed by the user or the like.

A specific example will be described. As illustrated in FIG. 7, theapparatus image 36 is displayed in the display region 76. A position ina region 90 indicated by a dashed line is a position where a distancefrom a central position of the apparatus image 36 is equal to or lessthan a threshold value. A dashed line or the like indicating the region90 may be displayed, and may not be displayed. In a case where a part orthe whole of an arrow image is disposed in the region 90, a dashed lineor the like indicating the region 90 may be displayed.

An arrow image 92 a is displayed outside the region 90 in the displayregion 76. In this case, the display control unit 26 does not displaythe connection portion image 36 a on the display unit. In other words,the connection portion image 36 a is not displayed to overlap theapparatus image 36.

Apart of an arrow image 92 b is displayed inside the region 90 in thedisplay region 76. In this case, the display control unit 26 displaysthe connection portion image 36 a to overlap the apparatus image 36 onthe display unit. For example, as indicated by an arrow 94, theconnection portion image 36 a is displayed in a case where the usermoves the arrow image displayed outside the region 90 into the region90. Of course, in a case where the whole of the arrow image 92 b isdisplayed in the region 90, the connection portion image 36 a may bedisplayed.

In a case where a part or the whole of the arrow image 92 b is displayedin a right region (a region corresponding to data output) of theapparatus image 36 inside the region 90, the display control unit 26displays the connection portion image 36 a for data output to overlapthe apparatus image 36 on the display unit. In a case where a part orthe whole of the arrow image 92 b is displayed in a left region (aregion corresponding to data input) of the apparatus image 36 inside theregion 90, the display control unit 26 displays a connection portionimage for data input to overlap the apparatus image 36 on the displayunit.

Since a connection portion image is not displayed in a case where adistance between a configuration image and an arrow image exceeds athreshold value, it is possible to prevent the configuration image frombeing displayed to be omitted due to being displayed to overlap theconnection portion image in that case.

A case where a distance between a configuration image and an arrow imageis equal to or less than a threshold value is a case where the usertries to connect an arrow image to a configuration image, or a casewhere an arrow image is on the verge of being connected to aconfiguration image, and, in other cases, it is supposed that it is notnecessary to display a connection portion image. Display or non-displayof a connection portion image is controlled according to a positionalrelationship between a configuration image and an arrow image, and thusthe above supposed cases can be coped with.

In a case where a function is allocated to each portion of aconfiguration, and a distance between a portion image of a configurationimage and an arrow image is equal to or less than a threshold value, thedisplay control unit 26 may display a connection portion image tooverlap the portion image on the display unit. For example, in a casewhere a distance between a portion image associated with the main bodyportion in the apparatus image 36 associated with the multi-functionperipheral B and an arrow image is equal to or less than a thresholdvalue, the display control unit 26 displays the arrow image to overlapthe portion image associated with the main body portion on the displayunit. In this case, in a case where a distance between a portion imageassociated with the postprocessing portion in the apparatus image 36 andan arrow image exceeds the threshold value, the display control unit 26does not display the arrow image to overlap the portion image associatedwith the postprocessing portion. In the above-described way, even in acase where a connection portion image is displayed for each portionimage, it is possible to prevent each portion image from being displayedto be unnecessarily omitted.

Modification Example 2

Hereinafter, with reference to FIG. 8, Modification Example 2 will bedescribed. FIG. 8 illustrates an example of a screen. In ModificationExample 2, in a case where an arrow image is already connected to aconnection portion image of a configuration image, and a distancebetween another arrow image and the configuration image is equal to orless than a threshold value, the display control unit 26 displaysanother connection portion image to overlap the configuration image onthe display unit.

A specific example will be described. As illustrated in FIG. 8, theapparatus images 36, 38, and 40 are displayed in the display region 76.The apparatus images 36 and 38 are connected to each other via an arrowimage 96. Specifically, the connection portion image 36 a for dataoutput is displayed to overlap the apparatus image 36, a connectionportion image 38 b 1 for data input is displayed to overlap theapparatus image 38, and the connection portion image 36 a and theconnection portion image 38 b 1 are connected to each other via thearrow image 96. In this state, in a case where a distance betweenanother arrow image 98 (an arrow image connected to the connectionportion image 40 a for data output displayed to overlap the apparatusimage 40) and the apparatus image 38 is equal to or less than athreshold value, the display control unit 26 displays a connectionportion image to overlap the apparatus image 38 on the display unit. Inthe example illustrated in FIG. 8, a connection portion image 38 b 2 fordata input is displayed to overlap the apparatus image 38. For example,in a case where a distance between a front end of the arrow image 98 andthe apparatus image 38 is equal to or less than a threshold value in aleft region (a region corresponding to data input) of the apparatusimage 38, the display control unit 26 displays the connection portionimage 38 b 2 for data input to overlap the apparatus image 38 on thedisplay unit. In the above-described way, even in a case where an arrowimage is already connected to a configuration image, another arrow imagecan be connected to the configuration image.

Although not illustrated, in a case where a distance between a front endof an arrow image and the apparatus image 38 is equal to or less than athreshold value in a right region (a region corresponding to dataoutput) of the apparatus image 38, the display control unit 26 displaysa connection portion image for data output to overlap the apparatusimage 38 on the display unit.

The setting unit 28 registers the sensor A, the multi-functionperipheral B, and the PC (D) in the set content management informationas configurations used for a cooperation function, and registers setcontents of the cooperation function executed by the configurations inthe set content management information. A function executed by eachconfiguration and a condition for executing the function are set by theuser. For example, data sensed by the sensor A and image data generatedby the multi-function peripheral B are output to the PC (D), andprocessing is performed on the data in the PC (D).

Modification Example 3

Hereinafter, with reference to FIG. 9, Modification Example 3 will bedescribed. FIG. 9 illustrates an example of a screen. In ModificationExample 3, the display control unit 26 changes a configuration imageaccording to a function associated with the configuration which isassociated with a configuration image displayed in the display region76. The display control unit 26 displays a configuration image in astate of not being associated with a function on the display unit beforethe configuration image is displayed in the display region 76, andchanges the configuration image according to the function in a casewhere the configuration image is displayed in the display region 76.

A specific example will be described. As illustrated in FIG. 9, theapparatus image 40 associated with the sensor A, a function image 100associated with a person sensing function, and an apparatus image 102associated with an electric lamp are displayed in the display region 76.The content indicated by the function image 100 may be said to be afunction of sensing a person, and may be said to be a condition such asa case of having sensed a person.

The connection portion image 40 a for data output on the apparatus image40 and a connection portion image 100 b for data input on the functionimage 100 are connected to each other via an arrow image 104. Aconnection portion image 100 a for data output on the function image 100and a connection portion image 102 b for data input on the apparatusimage 102 are connected to each other via an arrow image 106. In otherwords, in a case where a person is sensed by the sensor A, turning-on orturning-off of the electric lamp is controlled.

For example, in a case where the user designates the apparatus image 102(for example, the user clicks the apparatus image 102), the displaycontrol unit 26 displays a list 108 of functions of the electric lampassociated with the apparatus image 102 on the display unit. Forexample, the electric lamp has a lighting function and an unlightingfunction. The user may select a function to be executed by the electriclamp from the list 108. The display control unit 26 changes theapparatus image 102 according to the function selected by the user. Forexample, in a case where the user selects the lighting function, thedisplay control unit 26 displays the apparatus image 102 indicatinglighting on the display unit. On the other hand, in a case where theuser selects the unlighting function, the display control unit 26displays an apparatus image (an image which is different from theapparatus image 102) indicating unlighting on the display unit. In acase where the lighting function is selected by the user, and acooperation function is set, the electric lamp is lighted at the time ofa person being sensed by the sensor A. On the other hand, in a casewhere the unlighting function is selected by the user, and a cooperationfunction is set, the electric lamp is unlighted at the time of a personbeing sensed by the sensor A. As mentioned above, an apparatus image ischanged according to a function set in the apparatus 12. This is alsothe same for a function set in software.

Since a configuration image is changed according to a function, and thusa configuration image in which the function is reflected is displayed,the function set in the configuration image can be visually delivered tothe user.

It is not necessary to separately create a configuration image in whicheach function is reflected. For example, instead of separately creatingan apparatus image associated with the lighting function and anapparatus image associated with the unlighting function and ofdisplaying the apparatus images in the display region 78 as stockedimages, the number of stocked images displayed in the display region 78can be reduced by displaying an apparatus image (basic image) which canswitch between the lighting function and the unlighting function in thedisplay region 78 as a stocked image. In the example illustrated in FIG.9, an apparatus image 110 (a basic image associated with the electriclamp) which is associated with the electric lamp and in which neitherthe lighting function nor the unlighting function is reflected isdisplayed in the display region 78 as a stocked image. In other words,the apparatus image 110 may be said to be an image indicating anelectric lamp in a state of not being associated with a function. Asindicated by an arrow 112, in a case where the apparatus image 110 ismoved from the display region 78 to the display region 76 in response tothe user's operation so as to be displayed in the display region 76, anda function (for example, the lighting function) is set in the electriclamp, the apparatus image 110 is changed to an apparatus image (forexample, the apparatus image 102) in which the set function isreflected.

Configuration images in which respective functions are reflected may beseparately created and displayed in the display region 78.

FIG. 10 illustrates an apparatus image 114 in a case where theunlighting function is selected by the user. The apparatus image 114 isan image indicating unlighting. The unlighting function is included in acooperation function by the apparatus image 114. In this case, asdescribed above, in a case where a person is sensed by the sensor A, theelectric lamp is unlighted.

In a case where display of a configuration image is changed, the settingunit 28 changes a cooperation function to be set according to thechange. For example, in a case where the lighting function is set, andthe apparatus image 102 indicating lighting is displayed, the settingunit 28 sets a cooperation function including the lighting function. Ina case where the lighting function is changed to the unlightingfunction, and the apparatus image 102 is changed to the apparatus image114 indicating unlighting, the setting unit 28 changes the cooperationfunction including the lighting function to a cooperation functionincluding the unlighting function. As mentioned above, a cooperationfunction can be changed by changing a configuration image.

In a case where a configuration image (basic image) displayed in thedisplay region 78 as a stocked image is displayed in the display region76 in response to the user's operation, the display control unit 26 maydisplay candidates of configuration images in which respective functionsof a configuration associated with the configuration image are reflectedon the display unit. As illustrated in FIG. 11, for example, it isassumed that the apparatus image 110 associated with the electric lampis moved from the display region 78 to the display region 76 so as to bedisplayed in the display region 76. Since the electric lamp has thelighting function and the unlighting function, the display control unit26 displays the apparatus image 102 in which the lighting function isreflected and the apparatus image 114 in which the unlighting functionis reflected around the apparatus image 110 as candidates ofconfiguration images in the display region 76. The display control unit26 may display the apparatus images 102 and 114 in a translucent stateon the display unit, and may display the apparatus images 102 and 114 ina state of being reduced more than the apparatus image 110 which is abasic image on the display unit. Of course, as another display aspect,the display control unit 26 may display the apparatus images 102 and 114on the display unit in an aspect which is different from that of theapparatus image 110 as a basic image.

In a case where the user selects an apparatus image of the apparatusimages 102 and 114, the display control unit 26 displays the selectedapparatus image in the display region 76, and does not display theunselected apparatus image and the apparatus image 110 (basic image).The setting unit 28 sets a function associated with the selectedapparatus image as a function included in a cooperation function.

In the display region 76, candidates of configuration images aredisplayed around a basic image, and thus candidates of functions ofconfigurations associated with the configuration images are presented tothe user.

The display control unit 26 may display information indicatingcandidates of functions to be set in configurations on the display unitaccording to a relationship between the configurations displayed in thedisplay region 76. For example, it is assumed that a function oflighting the electric lamp in a case where a person is sensed is set inthe electric lamp as a function prioritized more than a function ofunlighting the electric lamp in a case where a person is sensed. In thiscase, in a case where the function image 100 associated with the personsensing function is displayed in the display region 76, the displaycontrol unit 26 displays the apparatus image 102 in which lighting isreflected on the display unit, and does not display the apparatus image114 in which unlighting is reflected. As mentioned above, a functionsupposed to be used through a combination with other configurations maybe set in advance for each configuration so as to be associated with theconfiguration, and the display control unit 26 may display aconfiguration image in which the function supposed to be used incombination with other configurations according to the association isreflected on the display unit. In the above-described way, candidates ofconfiguration images are narrowed. Information indicating theassociation is stored in, for example, the terminal equipment 10 or theapparatus 12.

In the examples illustrated in FIGS. 9 to 11, a configuration image ischanged according to a set function, but text indicating a function, acondition, a process, or a role may be changed. With reference to FIG.12, this process will be described. As illustrated in FIG. 12, theapparatus image 38 associated with the PC (D), a function image 116associated with a touch operation, and a function image 118 associatedwith an electronic mail function are displayed in the display region 76.The content indicated by the function image 116 associated with thetouch operation may be said to be a function regarding the touchoperation, and may be said to be a condition regarding the touchoperation.

The connection portion image 38 a for data output on the apparatus image38 and a connection portion image 116 b for data input on the functionimage 116 are connected to each other via an arrow image 120. Aconnection portion image 116 a for data output on the function image 116and a connection portion image 118 b for data input on the functionimage 118 are connected to each other via an arrow image 122. In otherwords, in a case where a condition regarding the touch operation issatisfied, electronic mail software is activated in the PC (D).

For example, in a case where the user designates the function image 116(for example, the user clicks the function image 116), the displaycontrol unit 26 displays a list 124 of touch operations associated withthe function image 116 on the display unit. For example, as a specificcontent of the touch operation, “touch” and “release touch” are includedin the list 124. The user may select a specific content of the touchoperation from the list 124. The display control unit 26 changes thefunction image 116 according to the touch operation selected by theuser. For example, in a case where the user selects “touch”, the displaycontrol unit 26 changes the text displayed in the function image 116 totext “touch”. On the other hand, in a case where the user selects“release touch”, the display control unit 26 changes the text displayedin the function image 116 to text “release touch”. In a case where“touch” is selected as a specific content of the touch operation by theuser, a cooperation function is set, and the touch operation isperformed on the PC (D), the electronic mail software is activated inthe PC (D). On the other hand, in a case where “release touch” isselected as a specific content of the touch operation by the user, acooperation function is set, and the touch operation on the PC (D) isreleased, the electronic mail software is activated in the PC (D).

Since text displayed in a function image is changed according to afunction, a condition, a process, or a role, a function or the like setin a function image can be visually delivered to the user.

It is not necessary to create both of a function image indicating anoperation such as “touch” and a function image indicating an operationsuch as “release touch” in advance and to display the function images inthe display region 80 as stocked images. For example, a function imagein which the text “touch” is displayed is displayed in the displayregion 80, the function image is displayed in the display region 76,and, in a case where the function image is designated by the user, thelist 124 is displayed. In a case where a specific operation is selectedby the user from the list 124, a function image (for example, thefunction image 116) including text indicating the selected operation(for example, “touch”) is displayed. In this case, the function imageincluding the text “touch” displayed in the display region 80corresponds to a basic image. In the above-described way, the number ofstocked image displayed in the display region 80 can be reduced comparedwith a case where both a function image indicating an operation such as“touch” and a function image indicating an operation such as “releasetouch” are displayed in the display region 80.

Function images indicating respective operations may be separatelycreated and be displayed in the display region 78.

The display control unit 26 may display specific contents regarding thetouch operation on the display unit as candidates according to arelationship with another configuration. For example, an operationsupposed to be executed in combination with other configurations may beset in advance, and the display control unit 26 may display a functionimage including text indicating the executed operation according to thesetting on the display unit. For example, activation of the PC (D), thetouch operation, and the electronic mail software is set in advance asprioritized setting, and the apparatus image 38 associated with the PC(D) and the function image 118 associated with the electronic mailsoftware are displayed in the display region 76, the display controlunit 26 displays the function image 116 including the text “touch” inthe display region 76.

Modification Example 4

Hereinafter, with reference to FIG. 13, Modification Example 4 will bedescribed. FIG. 13 illustrates an example of a screen. In ModificationExample 4, in a case where a plurality of configuration imagesassociated with a plurality of configurations used for a cooperationfunction are connected to each other, the setting unit 28 cancels thecooperation of the plurality of configurations in a case where aconfiguration image is operated by the user, and an operation amount isequal to or more than a threshold value. In this case, the setting unit28 deletes a set content of the canceled cooperation function from theset content management information, and cancels the cooperation functionset in each configuration.

The operation may include, for example, an operation of moving aconfiguration image on a screen, an operation of twisting an arrowimage, and an operation of cutting an arrow image. The operation amountmay include, for example, a movement amount of a configuration image,and a twisting amount of an arrow image.

A specific example will be described. As illustrated in FIG. 13, forexample, the apparatus image 36 associated with the multi-functionperipheral B, the function image 64 associated with the preservationfunction, and the apparatus image 38 associated with the PC (D) aredisplayed in the display region 76. It is assumed that the apparatusimage 36 and the function image 64 are connected to each other via anarrow image, and the function image 64 and the apparatus image 38 areconnected to each other via an arrow image. In this state, for example,in a case where the user moves the function image 64 far away from theapparatus image 36, and a movement amount thereof is equal to or morethan a threshold value, the display control unit 26 cuts the arrow imagewhich connects the apparatus image 36 to the function image 64, anddisplays an image indicating the cut state on the display unit asindicated by the reference numeral 126. The setting unit 28 cancelscooperation of the multi-function peripheral B and the preservationfunction. Of course, the arrow image may be cut by operating theapparatus image 36. The threshold value may be set in advance, and maybe changed by the user or the like. Even in a case where the arrow imageis cut, the arrow image 88 connecting the function image 64 to theapparatus image 38 is not cut unless a cutting condition is satisfied.

In a case where the arrow image connecting the apparatus image 36 to thefunction image 64 is cut, and then a predetermined time elapses, thedisplay control unit 26 may not display the cut arrow image. Forexample, the display control unit 26 may not display the cut arrow imageconnected to the function image 64, and may display the cut arrow imageconnected to the apparatus image 36 on the display unit in a state ofbeing connected to the apparatus image 36. Of course, the displaycontrol unit 26 may not display the cut arrow image connected to theapparatus image 36, and may display the cut arrow image connected to thefunction image 64 on the display unit in a state of being connected tothe function image 64. The display control unit 26 may not display theconnection portion images 36 a and 64 b.

As another example, in a case where the user moves the function image 64far away from the apparatus image 36 at movement velocity or movementacceleration which is equal to or more than a threshold value, thedisplay control unit 26 may cut the arrow image connecting the apparatusimage 36 to the function image 64, and the setting unit 28 may cancelthe cooperation function.

As illustrated in FIG. 14, in a case where the user twists an arrowimage 128 connecting configuration images to each other, and a twistingamount is equal to or more than a threshold value, the display controlunit 26 may cut the arrow image 128 as indicated by the referencenumeral 130.

In a case where the user moves a configuration image on the screen, andbrings the configuration image into contact with another configurationimage at movement velocity or movement acceleration which is equal to ormore than a threshold value, the setting unit 28 may cancel acooperation function set between a configuration associated with theconfiguration image and another configuration associated with anotherconfiguration image. In this case, the display control unit 26 maydisplay an image indicating a state in which the configurationassociated with the moved configuration image is destroyed on thedisplay unit. For example, in a case where the apparatus imageassociated with the electric lamp is moved and is brought into contactwith another configuration image, an image indicating a broken electriclamp is displayed. In a case where a configuration image associated witha fragile object is brought into contact with another configurationimage, the cancelation may be performed. The fragile object is set inadvance. For example, a glass product such as an electric lamp isregistered as the fragile object.

The display control unit 26 may reflect the weight of the apparatus 12in an aspect of movement of an apparatus image. For example, anapparatus image associated with the heavy apparatus 12 may have a smallmovement amount for a movement operation, and may be hardly moved.

Modification Example 5

Hereinafter, with reference to FIG. 15, Modification Example 5 will bedescribed. FIG. 15 illustrates an example of a screen. In ModificationExample 5, the display control unit 26 makes display contents of statesof each configuration different between a case where a cooperationfunction is set and a case where the cooperation function is not set.

For example, as illustrated in FIG. 15, the apparatus images 36 and 38,and the function image 64 are displayed in the display region 76, and acooperation function is assumed to be set in the multi-functionperipheral B, the preservation function, and the PC (D). In this case,in a case where the user designates the apparatus image 36 (for example,the user clicks the apparatus image 36) on the screen, the displaycontrol unit 26 displays information 132 indicating a state of themulti-function peripheral B regarding the set cooperation function onthe display unit. The information indicating a state regarding thecooperation function is, for example, information indicating anexecution situation of the cooperation function or informationindicating execution history of the cooperation function. For example,the set cooperation function is that image data (file) generated throughscanning in the multi-function peripheral B is transmitted to the PC(D), and is preserved in the PC (D). In this case, information (forexample, information indicating an execution situation or historyinformation) regarding the scanning in the multi-function peripheral Bis displayed as the information 132. For example, the information 132indicating that five files (image data) are generated through scanningin the multi-function peripheral B and are prepared to be transmitted isdisplayed. The information 132 may be said to be information indicatingan execution situation of scanning. In a case where the user designatesthe apparatus image 38 on the screen, the display control unit 26displays information 134 indicating a state of the PC (D) regarding theset cooperation function on the display unit. For example, informationregarding preservation in the PC (D) is displayed as the information134. In the example illustrated in FIG. 15, the information 134indicating that twenty new files have been preserved is displayed.

On the other hand, in a case where the user designates a configurationimage associated with a configuration in which the cooperation functionis not set, the display control unit 26 displays information having norelation to the cooperation function on the display unit. For example,in a case where the user designates the apparatus image associated withthe multi-function peripheral B displayed in the display region 78, thedisplay control unit 26 displays information 136 indicating performanceor the like of the multi-function peripheral B on the display unit.

The display control unit 26 acquires information indicating a state,performance, and the like of the apparatus 12 from the apparatus 12 viaa communication path. In a case where the user designates aconfiguration image associated with software, the display control unit26 acquires information indicating a state, performance, and the like ofthe software from the terminal equipment 10 or the apparatus 12 in whichthe software is installed, and displays the information on the displayunit. Also in this case, displayed information differs in a case where acooperation function is set in the software and a case where thecooperation function is not set in the software.

Modification Example 6

Hereinafter, with reference to FIG. 16, Modification Example 6 will bedescribed. FIG. 16 illustrates an example of a screen. For example, ascreen 138 may be displayed on the display unit of the UI section 20,and the screen 74 for setting a cooperation function may be displayed ina display region 140 of the screen 138. The screen 138 is, for example,a desktop screen or a home screen.

A file image 142 associated with data (file), a function image 144associated with a table transfer function, and the apparatus image 38associated with the PC (D) are displayed in the display region 76, and acooperation function is set in the data, the table transfer function,and the PC (D). For example, a cooperation function that a designatedfile is transmitted to the PC (D) and the file is transferred to a tablein the PC (D) is set.

A file image 146 associated with the file is displayed in the displayregion 140.

It is assumed that the table transfer function (the terminal equipment10 or the apparatus 12) having received a file serves as a trigger, andthus the cooperation function is executed. In this case, after settingof the cooperation function is completed, for example, in a case wherethe file image 146 displayed in the display region 140 is moved to thedisplay position of the file image 142 as indicated by an arrow 148, toa display position of an arrow image connecting the configuration imagesto each other, or the display position of the function image 144associated with the table transfer function in the display region 76through the user's operation, the movement may serve as a trigger, andthus the cooperation function may be executed. In a case where thetrigger based on the movement of the file image 146 is sensed, thecontrol section 24 starts execution of the cooperation function. Forexample, the control section 24 executes the cooperation function bycontrolling the apparatus 12 and software used for the cooperationfunction. The cooperation function is executed through such a fileoperation.

Modification Example 7

Hereinafter, with reference to FIG. 17, Modification Example 7 will bedescribed. FIG. 17 illustrates an example of a screen. As illustrated inFIG. 17, the apparatus image 36 associated with the multi-functionperipheral B, the apparatus image 38 associated with the PC (D), and theapparatus image 40 associated with the sensor A are displayed in thedisplay region 76. The connection portion image 36 a for data output onthe apparatus image 36 and the connection portion image 38 b for datainput on the apparatus image 38 are connected to each other via thearrow image 96. The connection portion image 40 a for data output on theapparatus image 40 and the connection portion image 38 b for data inputon the apparatus image 38 are connected to each other via the arrowimage 98. As mentioned above, a plurality of arrow images may beconnected to a single connection portion image.

During execution of a cooperation function, in a case where data fromthe multi-function peripheral B is input to the PC (D), and data fromthe sensor A is input to the PC (D), the PC (D) may execute a functionset therein. As another example, in a case where data from themulti-function peripheral B and data from the sensor A are input to thePC (D) simultaneously or within a predetermined time range, the PC (D)may execute a function set therein. The setting unit 28 registers a setcontent of the cooperation function in the set content managementinformation.

In the example illustrated in FIG. 17, a plurality of arrow images areconnected to a single connection portion image for data input, but aplurality of arrow images may be connected to a single connectionportion image for data output such that a single connection portionimage for data output is connected to a plurality of connection portionimages for data input. In this case, pieces of data which are the sameas or different from each other are output from the apparatus 12,software, or a function which is a data output source to the apparatus12, software, or a function which is a data output destination.

The setting unit 28 may change a cooperation function to be setaccording to a display relationship among a plurality of connectionportion images displayed on an identical configuration image. Forexample, the setting unit 28 changes a cooperation function to be set bychanging an execution timing of a process performed by a configurationassociated with the configuration image or a content of the processaccording to a display relationship among the plurality of connectionportion images. The setting unit 28 may make cooperation functions to beset different from each other in a case where a plurality of connectionportion images are separately displayed and a case where the pluralityof connection portion images are integrally displayed.

Hereinafter, with reference to FIGS. 18A, 18B, and 18C, such a processwill be described. Each of FIGS. 18A, 18B, and 18C illustrates theapparatus image 38 associated with the PC (D). As illustrated in FIG.18A, the connection portion images 38 b 1 and 38 b 2 for data input aredisplayed to overlap the apparatus image 38. The connection portionimages may be operated by the user. For example, in a case where theuser performs an operation of moving the connection portion image 38 b 2in a direction of an arrow 150 on the screen, the display control unit26 moves the connection portion image 38 b 2 in the direction of thearrow 150 on the apparatus image 38. Of course, the connection portionimage 38 b 1 may be operated to be moved. As illustrated in FIG. 18B,the connection portion images 38 b 1 and 38 b 2 may be brought intocontact with each other due to the movement. As illustrated in FIG. 18C,the display control unit 26 may combine the connection portion images 38b 1 and 38 b 2 brought into contact with each other so as to generate asingle connection portion image 152, and may display the connectionportion image 152 to overlap the apparatus image 38. A size of theconnection portion image 152 may be larger or smaller than a size ofeach of the connection portion images 38 b 1 and 38 b 2 before beingcombined, and may be the same as the size of each of the connectionportion images 38 b 1 and 38 b 2. A shape of the connection portionimage 152 may or not be the same as a shape of each of the connectionportion images 38 b 1 and 38 b 2. The connection portion image 152 maybe divided into a plurality of connection portion images by the useroperating the connection portion image 152.

The setting unit 28 may change a cooperation function to be setaccording to the display form of the connection portion imageillustrated in each of FIGS. 18A, 18B, and 18C.

For example, as illustrated in FIG. 18A, it is assumed that theconnection portion images 38 b 1 and 38 b 2 are separately displayed tobe separated from each other, and are respectively connected to arrowimages extending from connection portion images for data output. In thiscase, during execution of a cooperation function, the PC (D) separatelyprocesses first data which is input to the PC (D) from a firstconfiguration connected to the connection portion image 38 b 1 andsecond data which is input to the PC (D) from a second configurationconnected to the connection portion image 38 b 2. For example, in a casewhere the first data and the second data are input to the PC (D) atdifferent timings, the PC (D) individually processes each piece of dataat the input timing.

As illustrated in FIG. 18B, it is assumed that the connection portionimages 38 b 1 and 38 b 2 are displayed to be brought into contact witheach other, and are respectively connected to arrow images extendingfrom connection portion images for data output. In this case, duringexecution of a cooperation function, in a case where the first data isinput to the PC (D), and the second data is input to the PC (D), the PC(D) executes a function set in the PC (D).

As illustrated in FIG. 18C, it is assumed that the combined connectionportion image 152 is connected to arrow images extending from the firstconfiguration and the second configuration. In this case, duringexecution of a cooperation function, in a case where the first data andthe second data are input to the PC (D) simultaneously or within apredetermined time range, the PC (D) executes a function set therein.

As mentioned above, a cooperation function to be set is changed bychanging a display form of one or a plurality of connection portionimages.

A plurality of connection portion images for data output may be combinedor divided.

Hereinafter, with reference to FIG. 19, a description will be made of aset content management table as an example of the set content managementinformation. FIG. 19 illustrates an example of the set contentmanagement table. In the set content management table, as an example, anID, configuration identification information for identifying aconfiguration used for a cooperation function, and informationindicating a set content of the cooperation function are correlated witheach other.

A cooperation function having the ID “1” is a cooperation function whichis executable by using the multi-function peripheral B and apresentation application P. A cooperation function having the ID “2” isa cooperation function which is executable by using the multi-functionperipheral B and a destination management application Q. A cooperationfunction having the ID “3” is a cooperation function which is executableby using the multi-function peripheral B, the main body portion B1, andthe PC (D). A cooperation function having the ID “4” is a cooperationfunction which is executable by using a document creation application Gand a business form creation application N. A cooperation functionhaving the ID “5” is a cooperation function which is executable by usingthe multi-function peripheral B and the business form creationapplication N. A cooperation function having the ID “6” is a cooperationfunction which is executable by using a door opening/closing sensor Eand a lighting apparatus F.

Each cooperation function illustrated in FIG. 19 is only an example, andother cooperation functions may be set.

During execution of a cooperation function, for example, the terminalequipment 10 or the repeater refers to the set content management tableso as to specify a plurality of configurations used for a cooperationfunction, and sends control information indicating an executioninstruction for the cooperation function to the plurality ofconfigurations. Each configuration receiving the control informationperforms a process allocated thereto according to the controlinformation. In the above-described way, the cooperation function isexecuted. Of course, after setting of a cooperation function iscompleted, the setting unit 28 may set in advance a set content of thecooperation function in each configuration. In this case, eachconfiguration performs a process according to an execution timing of aprocess allocated thereto.

Each of the terminal equipment 10 and the apparatus 12 is realizedthrough cooperation of hardware and software as an example.Specifically, each of the terminal equipment 10 and the apparatus 12includes one or a plurality of processors such as CPUs (notillustrated). The one or plurality of processors read a program storedin a storage device (not illustrated) and execute the program, and thusa function of each unit of each of the terminal equipment 10 and theapparatus 12 is realized. The program is stored in a storage device viaa recording medium such as a CD or a DVD, or a communication path suchas a network. As another example, each unit of each of the terminalequipment 10 and the apparatus 12 may be realized by a hardware resourcesuch as a processor, an electronic circuit, or an application specificintegrated circuit (ASIC). A device such as a memory may be used for therealization. As still another example, each unit of each of the terminalequipment 10 and the apparatus 12 may be realized by a digital signalprocessor (DSP) or a field programmable gate array (FPGA).

The foregoing description of the exemplary embodiments of the presentinvention has been provided for the purposes of illustration anddescription. It is not intended to be exhaustive or to limit theinvention to the precise forms disclosed. Obviously, many modificationsand variations will be apparent to practitioners skilled in the art. Theembodiments were chosen and described in order to best explain theprinciples of the invention and its practical applications, therebyenabling others skilled in the art to understand the invention forvarious embodiments and with the various modifications as are suited tothe particular use contemplated. It is intended that the scope of theinvention be defined by the following claims and their equivalents.

What is claimed is:
 1. An information processing apparatus, comprising:a processor, wherein an image indicating a configuration for acooperation function and a connection image connecting the imageindicating the configuration are provided, and after a plurality ofimages indicating the configurations are connected by the connectionimage, in a case where the image indicating the configuration isoperated or an operation is applied to the connection image, theprocessor cancels a cooperation setting of the cooperation function andmakes a change in correspondence with an operation adding arepresentation of the connection image.
 2. The image processingapparatus as claimed in claim 1, wherein the processor further unlocksthe cooperation function by bringing the images indicating theconfigurations into contact.
 3. The image processing apparatus asclaimed in claim 2, wherein in a case where the images indicating theconfigurations are brought into contact, the processor further changesand displays the image indicating the configuration.
 4. The imageprocessing apparatus as claimed in claim 3, wherein in the case wherethe images indicating the configurations are brought into contact, theprocessor further changes the image indicating the configuration into animage of a destroyed state.
 5. The image processing apparatus as claimedin claim 1, wherein in a case where an instruction of moving the imageindicating the configuration is transmitted, the processor furtherchanges a movement amount in correspondence with a weight associatedwith the image indicating the configuration.